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© In a method of estimating motion per picture 
portion in an image of a picture signal, wherein, 
starting from a first (xO = x1, yO = y2) and a 
second (xO = x3. yO = y4) starting vector a motion 
vector is determined, a first and a second candidate 
motion vector, respectively, are determined on the 
basis of the first and second starting vector in accor- 
dance with a predetermined criterion, a motion vec- 
tor is selected from both candidate motion vectors, 
and as components of the starting vectors, respec- 
tive corresponding components of candidate motion 
vectors (x1, y1), (x2, y2), (x3, y3) and (x4 ( y4) 
already previously determined are taken, which can- 
didate motion vectors correspond respectively to the 
starting vectors. 
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MOTION ESTIMATION. 



The invention relates to a method of estimating 
motion of a picture portion in an image of a picture 
signal, comprising determining a number of can- 
didate motion vectors starting from a correspond- 
ing number of stating vectors, and selecting a 
motion vector out of the determined candidate mo- 
tion vectors. 

Such a method is described in US-A 4,853,775. 
Therein four starting vectors give rise to four can- 
didate motion vectors, and only that motion vector 
is selected, out of these four candidate motion 
vectors, which gives a convergence of the used 
gradient algorithm with the smallest frame differ- 
ence. The four starting vectors correspond to mo- 
tion vectors already estimated for four neighboring 
pixels in the causal neighborhood of the present 
pixel. 

The invention has inter alia for its object to 
provide an improved motion estimation. 

A method of the type defined in the opening 
paragraph is therefore characterized by taking as 
components of the starting vectors, components of 
candidate vectors already previously determined, 
which candidate motion vectors correspond respec- 
tively to the starting vectors, and which candidate 
motion vector components correspond respectively 
to the starting vector components. 

Unless explicitly stated differently in this de- 
scription, a picture portion may consist of a single 
picture element or of a group (for example a block) 
of picture elements. 

Because according to the invention, instead of 
the components of an ultimately selected motion 
vector of a neighboring picture portion, respectively 
corresponding components of at least one can- 
didate motion vector determined for that neighbor- 
ing picture portion are taken as components of 
each starting vector, which candidate motion vec- 
tors correspond respectively to the starting vectors, 
the advantage is obtained that a convergence di- 
rection associated with each starting vector compo- 
nent, for example from top to bottom or from left to 
right in the picture, is fully calculated, even if a 
candidate motion vector used for composing a 
starting vector did not lead to the best results for 
its own picture portion. However, it has been found 
that the motion vectors thus obtained are better 
than the motion vectors based on starting vectors 
which were the ultimately selected, best motion 
vector of a neighboring picture portion. A candidate 
motion vector which corresponds to a starting vec- 
tor and is already previously determined for, exam- 
ple, a left-hand adjacent picture portion, is to be 
understood to be that candidate motion vector that 
is based on a starting vector which, in its turn, is a 



candidate motion vector of a left-hand adjacent 
picture portion of said left-hand adjacent picture 
portion. 

An embodiment of the motion estimating meth- 

5 od according to the invention is characterized in 
that picture elements of each picture portion are 
divided into a first and a second respective group 
by sub-sampling the picture portion in a first and^a 
second phase, a first candidate motion vector be- 

w ing determined for the first group and a second 
candidate motion vector being determined for the 
second group. It is not necessary to use twice the 
number of circuit elements for the realisation of the 
dual motion estimation, compared to a single mo- 
rs tion estimation, because only half the number of 
picture elements are left for each group because of 
this sub-sampling operation, more specifically a 
different half for each phase. Therefore, in this 
embodiment each picture portion comprises at 

20 least two picture elements. 

A further embodiment of the method according 
to the invention is characterized in that a first 
component of a first starting vector is taken to be 
equal to a first component of a first candidate 

25 motion vector already previously determined for a 
first picture portion, a second component of said 
first starting vector is taken to be equal to a second 
component of a second candidate motion vector 
already previously determined for a second picture 

30 portion, while the first and second picture portions 
do not coincide, and in that a first component of a 
second starting vector is taken to be equal to a first 
component of a third candidate motion vector al- 
ready determined for a third picture portion, a 

35 second component of said second starting vector is 
taken to be equal to a second component of a 
fourth candidate motion vector already determined 
for a fourth picture portion, while the third and 
fourth picture portions do not coincide. Thus, the 

40 starting vectors are syntheses of components of 
two different candidate motion vectors already de- 
termined, and the risk that on passing beyond a 
contour in the picture, both components of the 
starting vectors belong to a different object than 

45 the object the present picture part belongs to, 
becomes smaller so that a quicker convergence to 
a correct (candidate) motion vector may be 
achieved. The first picture portion may, for exam- 
ple, be located opposite the third picture portion in 

so relation to the picture portion for which the motion 
is being estimated and the second picture portion 
may be opposite the fourth picture portion in rela- 
tion to the picture portion for which the motion is 
being estimated, so that an optimal independence 
between the two estimation results is obtained. 
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An embodiment thereof is characterized in that 
the third and fourth picture portions coincide with 
the second and first picture portions, respectively. 
In the example mentioned in the foregoing, in 
which the first picture portion was opposite the 
third portion, and the second picture portion op- 
posite the fourth portion, two picture portions are to 
the right of or lower in the picture than the picture 
portion for which the motion was being estimated. 
Because motion vectors must already be available 
for these two picture portions, a motion estimation 
must also be carried out from the bottom to the top 
in the picture or motion vectors determined for a 
previous picture should be used. For the realization 
of this motion estimation, either the picture ele- 
ments of the picture or the motion vectors, must be 
stored in a memory, so that an additional memory 
is required. This additional memory is not required 
in the present embodiment, since, if there are only 
two picture portions the estimated motion vector of 
which is used as a starting vector for a new estima- 
tion, these picture portions can be placed such in 
relation to the picture portion for which the motion 
is being estimated, that only a motion estimation 
from top to bottom in the picture is necessary. 

A still further elaboration of this embodiment,- is 
characterized in that the first and second picture 
portions have a smaller y-coordinate than the pic- 
ture portion for which the motion is being es- 
timated, the first picture having a smaller x-coordi- 
nate and the second picture portion having a larger 
x-coordinate than the picture portion for which the 
motion is being estimated. The x-coordinate in- 
creases from left to right, and the y-coordinate 
increases from top to bottom. Thus, compared with 
a possible embodiment in which the first picture 
portion is directly to the left of the picture portion 
for which the motion is being estimated, the advan- 
tage is obtained that a larger time interval now 
becomes available between the moment at which 
the first candidate motion vector can be defined 
and the moment at which this estimation result is 
needed again to obtain the starting vectors belong- 
ing to the present picture portion for which the 
motion is being estimated. 

A different embodiment according to the inven- 
tion is characterized in that the picture portions of a 
picture for each row of picture portions are shifted- 
ly stacked blocks of picture elements. This ap- 
peared to be a very suitable choice especially in 
connection with the still further elaboration de- 
scribed in the foregoing. 

According to, for example, the "One step at a 
Time Search" (OTS) criterion, disclosed in IEEE 
Transactions on Communications, No. 8, 1985, 
pages 888-896, the estimated motion vector may 
be equal to the starting vector. An embodiment of 
the method according to the invention is character- 



ized in that the candidate motion vectors are deter- 
mined in accordance with a criterion that provides 
that only a candidate motion vector which differs 
from the starting vector can be determined. Be- 

s cause of this, the algorithm is prevented from re- 
maining in a local minimum. 

A still further embodiment of the method ac- 
cording to the invention, is characterized in that 
components of the estimated motion vectors are 

10 spatially low-pass filtered. This provides a vector 
field without abrupt transients, which inspite of an 
inaccuracy caused by the low-pass filtering, ap- 
peared to lead to a finer result, because block- 
shaped errors in a picture interpolated by means of 

is the vectors obtained occur less frequently. Be- 
cause of the averageing effect of the low-pass 
filtration, a sub-pixel accuracy may even be ob- 
tained. Sub-pixel accuracy must be understood to 
mean an accuracy which is finer than the distance 

20 between subsequent picture elements. 

An elaboration thereof is characterized in that 
said low-pass filtering step includes the steps of 
recursively filtering said selected vector compo- 
nents to obtain output components; 

25 comparing said output components to said select- 
ed vector components to obtain a control signal 
indicating whether said selected vector compo- 
nents differ more than a given threshold from said 
output vector components; and 

30 disabling said recursively filtering step if said con- 
trol signal indicates that said selected vector com- 
ponents differ more than said given threshold from 
said output vector components. Due to the dis- 
abling of the postfiltering operation when the dif- 

35 ference between a newly estimated vector and a 
filtered output vector becomes larger than a given 
threshold, it is avoided that vectors belonging to 
different objects in the scene and moving in dif- 
ferent directions are averaged. 

40 A more specific embodiment thereof is char- 
acterized in that the low-pass-filtered vector com- 
ponents are submitted to a spatial sub-sampling 
operation which provides a saving in data, so that 
the method according to the invention can, for 

45 example, be used in an encoding section of a 
transmission or storage system, whereby in a cor- 
responding decoding section a motion-compensat- 
ed interpolation by means of transmitted vector 
information is performed. 

so A further embodiment of the method according 

to the invention is characterized in that previous to 
the motion estimation, the picture signal is tem- 
porally low-pass filtered by means of a temporal 
filter with coefficients (1/4, 1/2, 1/4), wherein from 

55 field to field lines from both neighbouring fields 
located alternately above or below a line in a 
present field are multiplied by the coefficient 1/4. 
Thus, the advantage is obtained that high vertical. 
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frequencies in a picture which might cause large 
differences between subsequent fields in the pic- 
ture, which are not caused by movement, are fil- 
tered out, so that a better motion estimation is 
obtained. In practice the filter used appears to 
provide good results. 

Another embodiment of the method according 
to the invention is characterized in that said can- 
didate motion vector determining step includes the 
steps of: 

taking the median of said picture signal, a field- 
delayed picture signal and a field- and line-delayed 
picture signal to obtain a filtered signal; and 
estimating said candidate motion vectors based on 
said picture signal and said filtered signal. Due to 
this median prefilter, a kind of quasi progressive 
scan signal is applied to the proper estimator, so 
that estimation errors caused by interlace are 
avoided. 

According to another aspect of the invention, 
there is provided a method of estimating motion 
per picture portion in an image of a picture signal 
wherein, starting from a starting vector, a motion 
vector is determined according to a previously de- 
fined criterion, characterized in that a first compo- 
nent of the starting vector is taken to be equal to a 
first component of a first already previously es- 
timated motion vector, belonging to a first picture 
portion, and a second component of the starting 
vector is taken to be equal to a second component 
of a second, already previously estimated motion 
vector, belonging to a second picture portion, said 
first and second picture portions not coinciding. 
This aspect of the present invention is based on 
the recognition that no optimum estimation result 
will be obtained, when during the estimation of a 
motion vector for a picture portion on one side of a 
contour a starting vector estimated for a picture 
portion on the other side of the contour and which 
therefore probably belongs to a different object, is 
used as the starting point. The measure according 
to this aspect of the invention, which provides that 
the starting vector is a synthesis of components of 
two different already previously estimated vectors, 
reduces the risk that during passing beyond a 
contour in the picture both components of the 
starting vector belong to the other object, so that a 
faster convergence to a correct motion vector can 
be obtained. 

An embodiment of this aspect of the invention 
is characterized in that for each picture portion not 
only said motion estimation, but also a second 
motion estimation is effected, in which for the sec- 
ond motion estimation components of a second 
starting vector are assumed to be equal to cor- 
responding components of third and fourth, already 
previously estimated motion vectors, respectively, 
which belong to third and fourth non-coinciding 



picture portions, respectively, and a second motion 
vector is determined starting from the second start- 
ing vector according to said criterion, whereafter 
from said first and second determined motion vec- 
5 tors, a best motion vector is selected. This pro- 
vides the advantage that the estimation result de- 
pends to a less extent on structures (contours) 
present in the picture because the best motion - 
vector, i.e. the motion vector which results in the 
70 smallest estimation error, is selected from two sep- 
arately defined candidate motion vectors, which m - 
were obtained by means of differrent starting vec- 
tors. In this situation, in relation to the picture 
portion for which the motion is being estimated, the 
75 first picture portion may be opposite to the third 
picture portion and the second picture portion may 
be opposite the fourth picture portion, whereby an 
optimal independence between both estimation re- 
sults is obtained. It should be noted that it is known 
20 per se from L Looijenga's graduation report, 
"Methodes voor bewegingscompensatie in een 
sequentie van beeiden", TU Delft, 1986, pp. 27-28, 
to select a starting vector from two candidate start- 
ing vectors by comparing which of these, as a 
25 motion vector, results in the smallest estimation 
error, to determine subsequently a motion vector, 
starting from the selected starting vector according 
to the previously defined criterion. 

These and other (more detailed) aspects of the 
30 invention will now be described and elucidated in 
greater detail with reference to the following non- 
limitative examples and drawings. 
In the drawing: 

Fig. 1 shows a first possible configuration of 
35 picture portions with associated vector compo- 
nents; 

Fig. 2 shows a second possible configuration of 
picture portions with associated vector compo- 
nents; 

40 Fig. 3 shows a configuration sampled in a first 
and a second phase, of shiftedly stacked blocks 
of picture elements; 

Fig. 4 shows the mode of operation of a tempo- 
ral prefilter with reference to a sketch of subse- 
45 quent rasters assembled from lines; 

Fig. 5 shows a possible structure of a spatial 
prefilter or postfilter; 

Fig. 6 shows an embodiment of a motion es- 
timator according to the invention; 
so Fig. 7 shows part of another embodiment of a 
motion estimator according to the invention, in 
which a median prefilter is placed before a can- 
didate motion vector determining circuit; and 
Fig. 8 shows a spatial postfilter for the estimated 
55 motion vectors. 

Fig. 1 shows a first possible configuration of 
picture portions with associated vector compo- 
nents. In the lower right-hand corner of Fig. 1, it is 



4 



EP 0 415 491 A1 



shown how the x- and y-coordinates are defined in 
the description and in the Claims. The x-coordinate 
increases therein from left to right, and the y- 
coordinate from top to bottom. In the middle of Fig. 
1 , a picture portion is indicated for which a motion 
vector is to be selected from two candidate motion 
vectors, which must be defined starting from two 
starting vectors (xO, yO) according to some pre- 
viously defined criterion. The starting vectors are 
composed of the components of candidate motion 
vectors already determined for other picture por- 
tions; for each starting vector at least one cor- 
responding candidate motion vector is used. It is to 
be noted that candidate motion vectors determined 
by estimations for neighboring picture portions are 
used to compose the starting vectors for the es- 
timation of the current picture portion <fr; it is irrele- 
vant whether the candidate motion vectors used 
are finally selected motion vectors. A candidate 
motion vector which corresponds to a starting vec- 
tor and is already previously determined for, for 
example, a picture portion adjacent to the left, must 
be understood to mean that candidate motion vec- 
tor that is based on a starting vector which, in its 
turn, is a candidate motion vector of a picture 
portion adjacent to the left thereof. Consequently a 
convergence direction belonging to each starting 
vector, for example, from top to bottom or from left 
to right in the picture, is fully calculated, even if a 
candidate motion vector thus obtained does not 
provide the best results. However, it was found that 
motion vectors thus obtained are better than mo- 
tion vectors based on starting vectors which were 
the ultimately selected, best motion vectors of a 
previous picture portion. It is thus necessary for 
each picture portion to have both starting vectors 
lead to a candidate motion vector, in order to be 
able to start from candidate motion vectors. 

A picture portion may be either a single picture 
element or a group (block) of picture elements. The 
previously defined criterion may be, for example, 
the "One step at a Time Search" (OTS) criterion 
mentioned in IEEE Transactions on Communica- 
tions, No. 8, 1985, pages 888-896, or the "Gradient 
Adaptive Search" criterion mentioned in the 5 th 
Intern. Conf. on Digital Processing of Signals in 
Communications, Loughborough, 20-23 September 
1988, publication No. 82, Institution of Electronic 
and Radio Engineers, page 109-115. The OTS cri- 
terion implies that a shift with the smallest possible 
associated estimation error is first looked for in the 
horizontal or x-direction. starting from the starting 
vector, and subsequently, starting from this shift, a 
shift with the smallest possible associated estima- 
tion error in the vertical or y-direction is looked for. 

The previously defined criterion may be a cri- 
terion in which the starting vector itself is a possi- 
ble estimation result, or a criterion in which the 



starting vector itself may not be an estimation 
result. If the starting vector itself cannot be an 
estimation result, less circuit elements are required 
for a criterion which compares estimation errors of 
5 a plurality of candidate motion vectors, because the 
estimation error occurring when using the starting 
vector now need not to be defined and compared. 
Furthermore, a criterion in which the starting vector 
itself is excluded, prevents the algorithm from get- 
io ting stuck in a local minimum. By using such a 
criterion, the motion estimation will result to a less- 
er extent in a similar estimation result for subse- 
quent picture portions, which however is no prob- 
lem because a spatial low-pass filtering of the 
75 vector components may remove oscillations caus- 
ed by the criterion around a correct vector value. 

When larger block sizes are used, a criterion 
which selects the vector having the smallest error 
on the axis having the largest fault gradient, was 
20 found to furnish good results. A criterion according 
to which four vectors (a ± k ( b) and (a, b ± k), with 
± k picture element variations in either the horizon- 
tal or the vertical direction relative to a starting 
vector (a, b) are compared in order' to determine 
25 which vector provides the best match, also pro- 
vides good results and, moreover, is easier to 
realise. In general it holds that the convergence 
rate may increase with increasing values for k but 
may sooner result in instabilities. In practice it 
30 appears that an optimum value for k equalled 1 
when a picture portion size of 1x2 picture elements 
is used, and that the optimum value for k equalled 
2 when a picture portion size of 4x8 is used. It is 
alternatively possible to have the value k depend 
35 on the value of the estimation error, such that for a 
relatively larger error a higher value for k is being 
taken, so that a different and, as is to be hoped, 
better vector may be found faster, while for a 
relatively small error a small value for k is suffi- 
40 cient, as the vector is apparently already fairly 
correct. Furthermore, it is possible to compare 
eight vectors obtained by means of values for k 
equal to 1 and 3, in one operation. 

In Fig. 1, first I and second II picture portions, 
45 respectively, are shown to the left of and above the 
central picture portion <f>, for which a first candidate 
motion vector (x1, y1) originating from the left and 
a second candidate motion vector (x2, y2) originat- 
ing from above, respectively, have already been 
so determined. In a very straightforward implementa- 
tion, the candidate motion vector (x1, y1) could be 
taken as a first starting vector of the central picture 
portion <J>, and the candidate motion vector (x2. y2) 
could be taken as a second starting vector of the 
55 central picture portion <f>. However, it is preferred 
that during determining the first candidate motion 
vector of the central picture portion a first start- 
ing vector is taken, the components of which origi- 
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nate from two already previously determined can- 
didate motion vectors, for example (xO = xl, yO = 
y2). The second starting vector may be the vector 
(xO = x3, yO = y4) t wherein the components x3 
and y4 originate from a third candidate motion 
vector (x3, y3) already determined, and a fourth 
candidate motion vector (x4, y4) already deter- 
mined, respectively, which belong to respective 
third III and fourth IV picture portions. Compared to 
the central picture portion <#> for which the motion is 
being estimated, the third III and fourth IV picture 
portions are located opposite the first picture por- 1 
tion I and the second picture portion II, respec- 
tively, so that an optimum independence between 
the two candidate motion vectors to be 'determined 
is obtained. As each starting vector is a synthesis 
of components of two candidate motion vectors 
already determined and belonging to two different 
picture portions, the risk is smaller that during 
passing, through a contour in the picture, both com- 
ponents of the starting vector belong to a different 
object than to which the present picture portion 
belongs, so that a faster convergence to a correct 
motion vector can be obtained. Each motion vector 
has its own convergence direction, in the example 
given the first starting vector component converges 
in the x-direction and the second starting vector 
component converges in the y-direction. Starting 
from each of these starting vectors, a candidate 
motion vectors is determined according to some 
previously defined criterion which starts from the 
corresponding starting vector. 

It is to be noted that the recognition that a 
starting vector of a motion estimation method pref- 
erably is composed of components derived from 
two motion vectors already estimated for two non- 
coinciding adjacent picture portions, is generally 
applicable and hot limited to use in combination 
with the recognition that a starting vector preferably 
is composed of components derived from at least 
one candidate motion vector instead of from at 
least one finally selected motion vector. 

A second possible configuration of continuous 
picture portions with accompanying vector compo- 
nents is shown in Rg. 2. This configuration, in 
which the first picture portion I is located obliquely 
above the picture portion <t> for which the motion 
must be estimated, has the advantage, that com- 
pared with the configuration shown in Fig. 1 in 
which the first picture portion l was located on the 
same line or lines as the picture portion for which 
the motion must be estimated, there is a larger 
time interval between the instant at which the can- 
didate motion vector (x1, y1) is determined and the 
instant at which this candidate motion vector is 
required for the composition of the starting vector 
(xO, yO). The starting vector may be compounded 
in the same manner as described in relation to Fig. 
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1 . The starting vector may also be the vector (xO = 
x1, yO = y2) for determining the first candidate 
motion vector and (xO = x2, yO = yt) for deter- 
mining the second candidate motion vector. This 

5 has the advantage that it is only necessary to 
proceed from the left upper corner of the picture, 
and not also from the right lower corner or using 
previous field motion vectors, to have estimation 
results of the candidate motion vectors (x3, y3) and 

70 (x4, y4) available to obtain the second starting 
vector, while there are still two sufficiently indepen- 
dently defined stating vectors. 

Another solution for the non-causality problem 
that arises if the candidate motion vectors of pic- 

75 ture portions III and IV shown in Figs. 1 or 2 are 
used, is to use the candidate motion vectors deter- 
mined for these picture portions during the pre- 
vious field period. 

If desired, it is also possible to compare the 

20 candidate motion vectors determined by starting 
from 4 starting vectors which are the corresponding 
candidate motion vectors of ali picture portions l-IV, 
while the candidate motion vectors of picture por- 
tions III and IV are again those determined during 

25 the previous field period. In another modification, 
each starting vector may be composed of the com- 
ponents of two candidate motion vectors already 
determined for the adjacent picture portions l-IV. 
Due to these modifications, a faster convergence of 

30 the algorithm can be obtained on passing beyond a 
contour in the picture, because estimation results 
from both sides of the contour are taken into ac- 
count 

According to yet another modification, it is pos- 

35 sible to select between an estimation based on 
previous field vectors and an estimation based on 
current field vectors. In this modification, the es- 
timation based on previous field vectors may use 
the configuration of Rg. 1, in which the candidate 

40 motion vectors of all picture portions l-IV are used. 
The estimation based on current field vectors may 
use the configuration of Fig. 2, in which only the 
candidate motion vectors of picture portions I and II 
are used. The selection between the estimation 

45 based on previous field vectors and the estimation 
based on current field vectors is preferably based 
on stored estimation errors which resulted when 
the candidate motion vectors (x1. y1) were applied 
to their own picture portions I of Fig. 1 and of Fig. 

so 2, respectively. As the selection is an a prior selec- 
tion, i.e. based on data which are known before 
either of the estimations is actually performed, it is 
not necessary to perform the non-selected estima- 
tion. It is of course also possible to base the 

55 selection on a comparison of the results obtained 
by the estimation based on previous field vectors 
and the estimation based on current field vectors, 
i.e. an a posteriori selection, but then more pro- 
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output (or alternatively, a previously estimated vec- 
tor) becomes too large, the newly estimated vector 
will probably belong to a different object in the 
scene moving in another direction, or, stated in 
another way, the best vector selection circuit 71 is 
switching between two different convergence direc- 
tions. In that case, averaging of motion vectors will 
only result in garbage, so that the filtering action 
would better be disabled. 

It is to be noted that while in the above de- 
scription several modifications and extensions have 
been described in combination with the invention 
as claimed, each of these modifications and exten- 
sions might also be used in combination with other 
motion estimators. For example, the described pre- 
and postfilters can be used with other motion es- 
timators as well. The Applicants hereby give notice 
that new Claims may be formulated to such fea- 
tures and/or combinations of features during the 
prosecution of the present Application or of any 
further Application derived therefrom. 



Claims 

1. A method of estimating motion of a picture 
portion in an image of a picture signal, comprising 
determining a number of candidate motion vectors 
starting from a corresponding number of starting 
vectors, and selecting a motion vector out of the 
determined candidate motion vectors, character- 
ized by taking as components of the starting vec- 
tors, components of candidate motion vectors al- 
ready previously determined, which candidate mo- 
tion vectors correspond respectively to the starting 
vectors, and which candidate motion vector compo- 
nents correspond respectively to the starting vector 
components. 

2. A method as claimed in Claim 1, characterized 
in that picture elements of each picture portion are 
divided into a first and a second group, respec- 
tively, by sub-sampling the picture portion in a first 
and a second phase, a first candidate motion vec- 
tor being determined for the first group and a 
second candidate motion vector being determined 
for the second group. 

3. A method as claimed in Claim 1 , characterized 
in that a first component of a first starting vector is 
taken to be equal to a first component of a first 
candidate motion vector already previously deter- 
mined for a first picture portion, a second compo- 
nent of said first starting vector is taken to be equal 
to a second component of a second candidate 
motion vector already previously determined for a 
second picture portion, while the first and second 
picture portions do not coincide, and in that a first 
component of a second starting vector is taken to 
be equal to a first component of a third candidate 



motion vector already determined for a third picture 
portion, a second component of said second start- 
ing vector is taken to be equal to a second compo- 
nent of a. fourth candidate motion vector already 
5 determined for a fourth picture portion, while the 
third and fourth picture portions do not coincide. 

4. A method as claimed in Claim 3, characterized 
in that the third and the fourth picture portions 
coincide with the second and first picture portions, 

70 respectively. 

5. A method as claimed in Claim 3 or 4, character- 
ized in that the first and the second picture portions 
have a smaller y-coordinate than the picture portion 
for which the motion is being estimated, the first 

is picture portion having a smaller x-coordinate and 
the second picture portion a larger x-coordinate 
than the picture portion for which the motion is 
being estimated. 

6. A method as claimed in any one of the preced- 
20 ing Claims, characterized in that the picture por- 
tions in a picture for each row of picture portions 
are picture element blocks which are shiftedly 
stacked. 

7. A method as claimed in any one of the preced- 
25 ing Claims, characterized in that the candidate mo- 
tion vectors are determined in accordance with a 
criterion that provides that only a candidate motion 
vector which differs from the starting vector can be 
determined. 

30 8. A method as claimed in any one of the preced- 
ing Claims, characterized in that components of the 
selected vectors are spatially low-pass filtered. 
9. A method as claimed in Claim 8, characterized 
in that said low-pass filtering step includes the 

35 steps of 

recursively filtering said selected vector compo- 
nents to obtain output components; 
comparing said output components to said select- 
ed vector components to obtain a control signal 

40 indicating whether said selected vector compo- 
nents differ more than a given threshold from said 
output vector components; and 
disabling said recursively filtering step if said con- 
trol signal indicates that said selected vector com- 

45 ponents differ more than said given threshold from 
said output vector components. 
10. A method as claimed in Claim 8. characterized 
in that the low-pass filtered vector components are 
spatially sub-sampled. 

so 11. A method as claimed in any one of the preced- 
ing Claims, characterized in that previous to the 
motion estimation the picture signal is temporally 
low-pass filtered utilizing a temporal filter having 
coefficients (1/4, 1/2, 1/4), wherein from field to 
55 field, lines from both adjacent fields, located al- 
ternately above or below a line of a present field 
are multiplied by the coefficient 1/4. 
12. A method as claimed in Claim 1, characterized 
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in that said candidate motion vector determining 
step includes the steps of: 
taking the median of said picture signal, a field- 
delayed picture signal and a field- and line-delayed 
picture signal to obtain a filtered signal; and 
estimating said candidate motion vectors based on 
said picture signal and said filtered signal. 
13. A method of estimating motion per picture 
portion in an image of a picture signal wherein, 
starting from a starting vector, a motion vector is 
determined according to a previously defined cri- 
terion, characterized in that a first component of 
the starting vector is taken to be equal to a first 
component of a first already previously estimated 
motion vector, belonging to a first picture portion, 
and a second component of the starting vector is 
taken to be equal to a second component of a 
second, already previously estimated motion vec- 
tor, belonging to a second picture portion, said first 
and second picture portions not coinciding. 
14. A method as claimed in Claim 13, character- 
ized in that for each picture portion, in addition to 
said estimation, a second motion estimation is also 
performed, wherein for the second motion estima- 
tion components of a second starting vector are 
assumed to be equal to respective corresponding 
components of third and fourth, respectively, al- 
ready previously estimated motion vectors asso- 
ciated with third and fourth, non-coinciding picture 
portions, respectively, and starting from the second 
starting vector a second motion vector is deter- 
mined in accordance with the said criterion, 
whereafter a best motion vector is selected from 
said first and said second determined motion vec- 
tors. 
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cessing equipment is required. The estimation 
based on previous field vectors can be simplified if 
among the previous field vectors, only the can- 
didate motion vector determined for the picture 
portion IV of Fig. 1 is taken into account, so that 
altogether picture portions I and II of Fig. 2 and 
picture portion IV of Fig. 1 are used. 

A configuration of shiftedly stacked blocks of 
two-by-four picture elements, sampled in a first and 
a second phase is shown in Fig. 3. The samples 
resulting from the sampling operation in the first 
phase are indicated in Fig. 3 by a "1", and the 
samples resulting from the sampling operation in 
the second phase are indicated in Fig. 3 by a "2". 
As only half the original number of picture ele- 
ments remains for each phase in this sampling 
operation, it becomes possible to carry out the dual 
motion estimation with different starting vectors ac- 
cording to the invention, without it being necessary 
to use twice the number of circuit elements. Here- 
in, use is made of starting vectors which are com- 
posed of vector components of candidate motion 
vectors already determined, belonging to blocks 
which are indicated by I and II in the method 
illustrated in Fig. 2 for the estimation of the motion 
of a block denoted by <f>. For example, the starting 
vector (xO = x1, yO = y2) is used for the first 
phase, and the starting vector (xO = x2, y0 = yl) 
is used for the second phase. It is also possible to 
use the starting vector (xO = x3, yO = y4) for the 
second phase, in which use is made of vector 
components of motion vectors already estimated, 
belonging to blocks that are indicated by III and IV. 
Obviously, any sampling method other than the 
method shown in the drawing can also be used; for 
example, it is not necessary to sample from line to 
line in anti-phase. 

The picture signal may be temporally low-pass 
filtered previous to the motion estimation. This has 
the advantage that high vertical frequencies in a 
picture, due to which large differences between 
subsequent fields of the picture occur that are not 
caused by motion, are being filtered out so that a 
better estimation result is obtained. The mode of 
operation of a preferred embodiment of the tem- 
pore! prefilter is shown schematically in Fig. 4. Fig. 
4 consists of two halves, separated by a dotted 
line, each showing schematically a number of lines 
from three subsequent fields of which the inter- 
mediate field is the present field to be filtered. The 
filter operates with coefficients (1/4, 1/2, 1/4), 
wherein, from field to field, lines from both neigh- 
bouring fields, lying alternately above or below a 
line of a present field, are being multiplied by the 
coefficient 1/4. In practice this filter appears to lead 
to good results. 

The picture signal may be spatially low-pass 
filtered, previous to the motion estimation, to re- 



duce influences of noise. The picture signal may 
also be spatially subsampled, which allows for a 
field memory to have only half the capacity needed 
otherwise. 

s If components of the selected vectors are spa- 

tially low-pass filtered, a vector field without abrupt 
transients is obtained which, inspite of the inaccu- 
racy caused thereby, appeared to provide a finer 
result, because errors in the form of blocks occur 
io less often in a picture having been interpolated 
using the obtained vectors. Through the averageing 
effect of the low-pass filtering, even a sub-pixel 
accuracy may be obtained, i.e. an accuracy which 
is finer than the distance between two subsequent 
*5 picture elements. The low-pass filtration of the es- 
timated motion vector components furthermore pro- 
vides the advantage that low-pass filtered vector 
components can be spatially sub-sampled, without 
fold-back effects being produced. The sub-sam- 
20 pling operation provides a saving in data, so that 
the method according to the invention can make 
use of a small picture portion size, which has the 
advantage that object boundaries may be followed 
appropriately, but has the disadvantage that the 
25 number of resultant vectors is large, while the 
method may still be applied in an encoding portion 
of a picture signal transmission or storage system, 
having only a limited capacity for the transmission 
of motion information for effecting a motion-com- 
30 pensated interpolation by means of the transmitted 
vector information, in a corresponding decoding 
section. With an interpolation of the picture signal 
by means of vector components, recovered 
through interpolation from the transmitted vector 
35 information, per smalt picture portions, block errors 
caused by block boundaries or large blocks, not 
coinciding with object boundaries are decreased, 
while, because of the sub-sampling operation of the 
vector components, no more vector information is 
40 being transmitted than would be transmitted if the 
motion would be estimated for larger blocks. 

A possible structure of a suitable spatial low- 
pass filter for the filtering operation, previous to the 
motion estimation, of the picture signal and/or for 
45 filtering of the estimated vector components, is 
shown in Fig. 5. An input 1 of the filter is con- 
nected to a first input 3 of an adder 5, of which an 
output 7 is connected to a second input 9 of the 
adder 5 via a memory P with a delay of a picture 
so element period. An output 11 of the memory P is 
connected to a first input 13 of an adder 15, of 
which an output 17 is connected to a second input 
19 of the adder 15 via a memory L with a delay of 
a line period. An output 21 of the memory L is 
55 connected to an output 23 of the spatial filter. 

An embodiment of a motion estimator accord- 
ing to the invention is shown in Fig. 6. An input 61 
of the motion estimator is connected to a first two- 
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phase sampling circuit 63, and to a second two- 
phase sampling circuit 69 via a field memory F. 
Each of these two-phase sampling circuits 63 and 
65 is connected to a first-phase candidate motion 
vector determining device 67 and a second-phase 
candidate motion vector determining device 69. 
The first-phase determining device 67 estimates 
the motion for the samples indicated by a "1 " in 
Fig. 3, and the second-phase determining device 
69 estimates the motion for the samples indicated 
by a M 2 rt in Fig. 3. The candidate motion vector 
determining devices 67 and 69 are connected to a 
best vector selection circuit 71 and to themselves, 
via vector component memories 73, 75, respec- 
tively, for the storage of new starting vector compo- 
nents. As is described in the foregoing, for the first- 
phase motion estimation a different starting vector 
is used than for the second phase motion estima- 
tion. The best vector selection circuit applies to an 
output 77 of the motion estimator the best vector 
from the candidate motion vectors estimated by 
candidate motion vector determining devices 67 
and 69. As can be seen from Fig. 6, inputs of the 
vector component memories 73 and 75 are con- 
nected to outputs of the respective candidate mo- 
tion vector determining devices 67, 69. This con- 
figuration according to the invention, in which, start- 
ing-from each starting vector, a separate candidate 
motion vector is determined and a motion vector is 
selected from both candidate motion vectors, and 
in which, as components of the starting vectors, the 
corresponding components, respectively, of the 
candidate motion vectors already determined and 
which respectively correspond to the starting vec- 
tors, are taken, appeared to furnish better results 
than a prior art like configuration in which the 
inputs of the vector component memories 73 and 
75 are connected to the output 77 of the best 
vector selection circuit 71, in which consequently, 
as components of the starting vector, respectively 
corresponding components of the selected best 
motion vector are taken. A candidate motion vector 
which corresponds to a starting vector and is al- 
ready determined for, for example, a left-hand adja- 
cent picture portion, should be understood to mean 
that candidate motion vector that is based on a 
starting vector which itself is a candidate motion 
vector of a picture portion immediately to the left of 
said left-hand adjacent picture portion. 

To implement the modification described 
hereinbefore which used both an estimation based 
on previous field vectors and an estimation based 
on current field vectors, each vector component 
memory (73 or 75) should comprise a first memory 
storing the candidate motion vectors from the cur- 
rent field, a second memory storing the candidate 
motion vectors from the previous field, and a 
switch for selectively coupling the output of the first 



memory or the output of the second memory to the 
candidate motion vector determining device (67 or 
69, respectively). This switch is controlled by 
stored estimation errors as described hereinbefore. 
5 As has been explained in the foregoing, the 

picture signal may be applied to the motion estima- 
tor via spatial and/or temporal low-pass filters (see 
Fig. 7). If there is both spatial and temporal filter- _ 
ing, the sequence spatial filtering first, followed by 
70 temporal filtering has the advantage that the mem- 
ory required for the temporal filtering can be small- 
er. Furthermore, the output 77 of the motion es- 
timator can be connected to a spatial low-pass filter 
(see Fig. 8) and optionally to a sampling circuit. 
T5 Fig. 7 shows part of another embodiment of a 

motion estimator according to the invention, in 
which a median prefilter is placed before a can- 
didate motion vector determining circuit. This 
median prefilter can be considered as an alter- 
20 native to the prefilter of Fig. 4. In Fig. 7 the input 
61 is coupled directly, through the field memory F, 
and through the series arrangement of the field 
memory F and a line memory L, to respective 
inputs of a median filter 79. Median filters as such 
25 are known in the art. see US-A 4,740,842 (PHN 
11,613). An output of the median filter 79 and the 
input 61 are coupled to respective inputs of a 
candidate motion vector determining circuit 81, 
which may comprise the combination of the can- 
30 didate motion vector determining device 69 and the 
vector component memory 75 as shown in Fig. 6. 
Due to this prefilter, a kind of quasi-progressive 
scan signal is applied to the candidate motion 
vector determining circuit, so that estimation errors 
35 caused by interlace are mitigated. 

Fig. 8 shows a spatial postfilter for the es- 
timated motion vectors. The output 77 of the mo- 
tion estimator (see Fig. 6) is coupled to a weighted 
averaging circuit comprising a first multiplier 83, an 
40 adder 85, a delay 87, and a second multiplier 89 
coupling the output of the delay 87 to a second 
input of the adder 85. The output of the postfilter is 
formed by the output of the delay 87, but may 
alternatively be formed by the output of the adder 
45 85. Multiplier 83 multiplies by a factor 1-k, and 
multiplier 89 multiplies by a factor k. According to 
a preferred embodiment, both multipliers are con- 
trolled by a non-linear device including a subtractor 
91 and a threshold circuit 93. The subtractor corn- 
so pares a newly estimated motion vector to the filter 
output, and if the difference between these two 
vectors is larger than a given amount, threshold 
circuit 93 sets the multiplying factor k, which nor- 
mally will be 1/2, to zero thus effectively disabling 
55 the filtering operation so that the newly estimated 
vector is outputted unfiltered. This switching action 
is based on the recognition that if the difference 
between a newly estimated vector and the filter 
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